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Abstract. Curriculum-based measurement in reading (CBM-R) is a widely used 
measure for identifying students in need of reading intervention and monitoring their 
progress. Despite a large base of research supporting the efficacy of CBM-R as a 
measure of comprehension, critics maintain that CBM-R is little more than a measure 
of word reading. The current study extends existing research by examining the extent 
to which CBM-R is a measure of student performance beyond word reading rate and 
accuracy as well as examining the benefits of administering a word list to early 
elementary students. Participants included 143 first-grade and 147 second-grade 
students. All students were administered a norm-referenced measure of reading 
achievement, two CBM-R passages, and two word lists. Results replicate and extend 
the literature by highlighting potential differences in the reading behavior of devel¬ 
oping and fluent readers and demonstrating the potential need to administer measures 
of word list reading when conducting screenings in early grades. 
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Perfetti’s (1985) verbal efficiency the¬ 
ory suggests that the demands placed on mem¬ 
ory and attention for reading words are de¬ 
creased as one becomes more proficient at 12 
reading words and that when these demands 
are decreased, greater attention can be given to 
the meaning of a passage. This theory is well 
supported and similarly postulated by others 
(e.g., LaBerge & Samuels, 1974), with studies 
indicating that word reading and listening 
comprehension skills account for practically 
all of the variance in students’ reading 
achievement (Tilstra, McMaster, van den 
Broek, Kendeou, & Rapp, 2009). Even when 
controlling for listening comprehension, word 
reading skills continue to explain significant 
variance in students’ reading comprehension 
(Tilstra et al., 2009). 

Deno (1985) developed Curriculum- 
Based Measurement of oral reading (CBM-R) 
based largely upon Perfetti’s (1985) verbal 
efficiency theory and the desire to develop a 
simple and quick assessment procedure to 
monitor student progress. CBM-R is a simple 
yet well-researched procedure that involves 
having students read passages for 1 min as an 
examiner records the number of words read 
correctly (WRCM). There is now an extensive 
body of research supporting CBM-R and con¬ 
sequently the position by many that reading 
fluency frees cognitive resources for compre¬ 
hension (LaBerge & Samuels, 1974; Perfetti, 
1985), with studies repeatedly demonstrating a 
strong relationship between students’ WRCM 
as measured using CBM-R procedures and 
various norm-referenced measures of reading 
achievement (Ardoin et al., 2004; Reschly, 
Busch, Betts, Deno, & Long, 2009). 

Meta-analyses by Reschly et al. (2009) 
indicated a strong relationship between 
CBM-R and various components of reading 
achievement. With the exception of word 
identification, which was found to have the 
strongest relationship with CBM-R, the 
strength of the relationship among CBM-R 
and other components of reading achievement 
(i.e., vocabulary, comprehension, decoding) 
did not differ. The nonsignificant difference in 
the strength of the relationship between 
CBM-R and various measures of reading 


achievement suggests that CBM-R is a general 
outcome measure of reading. However, critics 
of CBM-R might disagree that it is a general 
outcome measure because the stronger corre¬ 
lation between CBM-R and word identifica¬ 
tion measures suggests that CBM-R is simply 
a measure of students’ word identification 
speed. Moreover, the relationship between 
CBM-R and measures of reading achievement 
tends to decrease: (a) beyond fourth grade, 
when fewer students use decoding skills to 
read text (Jenkins & Jewell, 1993; Kranzler, 
Miller, & Jordan, 1999); and (b) when the 
passages used to assess student performance 
are easy and thus do not require students to 
employ their decoding skills (Spear-Swerling, 
2006). 

Words in Context: Contribution of 
CBM-R 

In attempting to dispel the critics sug¬ 
gesting CBM-R is simply a measure of decod¬ 
ing, Hamilton and Shinn (2003) evaluated dif¬ 
ferences in rate and comprehension between 
teacher-identified word callers and students 
identified by teachers as nonword callers with 
similar word reading rates to the word callers. 
All students’ skills were assessed using 
CBM-R, the Maze procedure (January & Ar¬ 
doin, 2012), a measure of comprehension re¬ 
quiring students to read a passage and respond 
to comprehension questions, and the compre¬ 
hension subtest of an individually adminis¬ 
tered norm-referenced achievement test. Re¬ 
sults indicated that the students identified as 
having better comprehension skills by the 
teachers demonstrated greater comprehension 
skills. However, in contrast to teachers’ per¬ 
ceptions of the word callers and nonword call¬ 
ers having equivalent oral reading rates, re¬ 
sults indicated that WRCM on the CBM-R 
measure was significantly lower for word call¬ 
ers than for children identified as having good 
comprehension skills. Although these results 
may be limited in that subjective judgments of 
teachers were used to identify students be¬ 
lieved to have only word identification skills 
and poor comprehension skills, other studies 
have illustrated the benefits of CBM-R over 
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assessing students’ word reading rate (Jenkins, 
Fuchs, van den Broek, Espin, & Deno, 2003a; 
Jenkins, Fuchs, van den Broek, Espin, & 
Deno, 2003b). Moreover, Compton and col¬ 
leagues (Compton et al., 2005; Olinghouse, 
Lambert, & Compton, 2006) found that mon¬ 
itoring students’ progress using CBM-R mea¬ 
sures explained variance in student reading 
beyond that explained by various word list 
measures. 

Outside of the CBM-R literature, there 
is further evidence suggesting that having stu¬ 
dents read words within context (i.e., CBM-R) 
measures more than their word identification 
skills (Cutting & Scarborough, 2006). For in¬ 
stance, research indicates that context assists 
students in reading words within passages at a 
significantly greater rate than when they read 
the same words outside of a passage (Jenkins 
et al., 2003a; Nicholson, 1991; Nicholson, 
Bailey, & McArthur, 1991). Jenkins et al. 
(2003a) explored these findings within the 
context of CBM-R. Fourth-grade students 
were administered the Iowa Test of Basic 
Skills (ITBS; 2001), a CBM-R passage (words 
within context), and a word list probe consist¬ 
ing of the same words presented in the 
CBM-R passage. Results revealed that stu¬ 
dents’ reading of words within context 
(CBM-R passages) was significantly greater 
than their reading of words out of context 
(word list) and that both reading words in and 
out of context explained significant variance in 
students’ reading comprehension as measured 
by the ITBS. Further analyses revealed that 
although there was considerable variance 
shared between CBM-R and word list reading 
rates, students’ CBM-R performance ex¬ 
plained variance above and beyond the read¬ 
ing of word lists. Students’ word list perfor¬ 
mance did not, however, explain variance in 
comprehension above and beyond student 
CBM-R performance. 

Further evidence that CBM-R is not 
simply a measure of word reading rate is pro¬ 
vided by Jenkins et al. (2003b). As opposed to 
only conducting the typical analysis examin¬ 
ing the degree to which variance in compre¬ 
hension is explained by students’ CBM-R per¬ 
formance, these researchers examined the 


variance in students’ CBM-R performance 
(context rate) explained by the ITBS compre¬ 
hension subtest and their performance on a 
word list. Results revealed that although both 
ITBS reading comprehension and reading of 
words out of context (word list) explained 
significant variances in students’ CBM-R per¬ 
formance, comprehension explained more 
than twice as much unique variance in CBM-R 
performance. The research described earlier 
suggested that the reading of words in context 
stimulates comprehension processes and stu¬ 
dents’ WRCM, when administered CBM-R 
passages, was reflective of those processes. 
Thus, although CBM-R is not a direct measure 
of comprehension, reading with fluency re¬ 
quires prerequisite skills (e.g., phonics, sight 
vocabulary) needed for the successful compre¬ 
hension of text (LaBerge & Samuels, 1974; 
Perfetti, 1985) and successful comprehension 
aids fluent reading (Jenkins et al., 2003a, 
2003b). Given the variables that influence flu¬ 
ent reading, CBM-R is often referred to and 
employed as a general outcome measure. 

Despite the strong body of research sug¬ 
gesting that CBM-R is a measure of more than 
word reading, it is important to recognize that 
much of this research was conducted with 
students in the third and fourth grades (Ham¬ 
ilton & Shinn, 2003; Jenkins et al. 2003a, 
2003b). In early elementary school (first and 
second grade), students are primarily at the 
stage of learning to read in which they are 
building decoding and sight vocabulary skills 
that help them to become fluent readers. By 
middle to late elementary school, many if not 
most students already have these skills and, 
when engaged in reading within the class¬ 
room, are reading to learn as opposed to learn¬ 
ing to read. 

Given differences in the general purpose 
of reading among early and upper elementary 
students, there may also be differences in the 
extent to which their performance on CBM-R 
passages and word lists explains variance in 
reading comprehension. For example, stu¬ 
dents’ performance when reading connected 
text (CBM-R passages) in first grade did not 
increase the prediction accuracy of students 
identified with a learning disability in second 
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grade (Compton et al., 2010). However, 
Compton and colleagues (2010) used a large 
battery of measures, including a measure of 
oral vocabulary, to predict learning disability 
identification in second grade, oversampled 
low-performing students, and the data col¬ 
lected to predict second-graders identified 
with a learning disability were collected in the 
fall of first grade. There is a strong possibility 
that many students, especially the lowest per¬ 
forming students, were receiving little instruc¬ 
tion in connected text and thus reading con¬ 
nected text with minimal to no fluency. Thus, 
differences between findings of Compton, 
Fuchs, Fuchs, and Bryant (2006), Compton et 
al. (2010), and Jenkins et al. (2003a, 2003b) 
may be from differences in methodology em¬ 
ployed across the two studies and/or differ¬ 
ences in the developmental reading level of 
participants, but do indicate a need for further 
research with students in first and second 
grades. 

Words Out of Context: Contribution of 
Word Lists 

Despite the aforementioned evidence 
that performance on CBM-R passages may be 
a stronger predictor of reading comprehension 
than performance on word lists, studies within 
and outside of the CBM-R literature provide 
strong evidence that a measure of student 
word list reading accuracy and rate does pro¬ 
vide meaningful information. Data derived 
from students’ word list reading performance 
may result in valid decisions for both identi¬ 
fying young students struggling in developing 
reading skills as well as monitoring their prog¬ 
ress (Compton et al., 2006; Compton et al., 
2010). Clemens, Shapiro, and Thoemmes 
(2011) found that among four early reading 
measures (word identification fluency, letter 
naming fluency, phoneme segmentation flu¬ 
ency, and nonsense word fluency) adminis¬ 
tered in the beginning of first grade, word 
identification fluency most accurately classi¬ 
fied those students with weak reading skills at 
the end of first grade. 

Outside of the CBM-R research, empir¬ 
ical studies examining the Simple View of 


Reading (i.e., the idea that reading compre¬ 
hension is largely a product of reading accu¬ 
racy and listening comprehension; Hoover & 
Gough, 1990) suggest that assessing student 
performance on word lists is beneficial and 
that word identification skills even explain 
significant variance in comprehension above 
that of listening comprehension (e.g., Adolf, 
Catts, & Little, 2006). The extent to which 
word reading accuracy predicts comprehen¬ 
sion does, however, decrease as students prog¬ 
ress through school. In an examination of a 
slightly more complex model of the Simple 
View of Reading, Tilstra et al. (2009) found 
that fourth-, seventh-, and ninth-grade stu¬ 
dents’ rate of reading words in context ex¬ 
plained significant variance in reading com¬ 
prehension after accounting for students’ de¬ 
coding skills, verbal proficiency, and listening 
comprehension skills. 

Purpose 

A substantial research base establishes 
that measures of students’ oral reading rate, as 
assessed using CBM-R procedures, provide 
information beyond that of the accuracy and 
rate at which students read words (Hamilton & 
Shinn, 2003; Jenkins et al. 2003a, 2003b). 
However, the existing research base relied ex¬ 
clusively upon middle to upper elementary 
grade students (i.e., third and above). For ex¬ 
ample, participants in both studies conducted 
by Jenkins et al. (2003a, 2003b) were fourth- 
grade students whose reading skills and pur¬ 
pose for reading words within (CBM-R pas¬ 
sages) and outside of texts (word list) likely 
differed considerably from first- and second- 
grade students who are in the early develop¬ 
ment of reading fluency. A primary purpose of 
this study was to evaluate whether CBM-R 
data reflect more than word reading rate and 
accuracy among early elementary students. 
We achieved this by (a) examining differences 
in students’ speed of reading words in and out 
of context and (b) examining variance ex¬ 
plained in reading comprehension by students’ 
CBM-R and word list reading rates as well as 
the degree to which word list reading rate and 
reading comprehension explained variance in 
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students’ CBM-R performance. Evidence that 
(a) CBM-R explains variance in reading com¬ 
prehension after accounting for that explained 
by word list reading rates, and (b) evidence 
that reading comprehension explains variance 
in CBM-R after accounting for that explained 
by word list reading rates, would provide 
strong evidence that even among early ele¬ 
mentary students CBM-R is measuring more 
than students’ word identification skills. 

A second purpose of the current study 
was to evaluate the utility of administering a 
word list reading rate measure to students in 
first and second grade. Currently, when con¬ 
ducting universal screenings, schools gener¬ 
ally do not administer word list measures to 
students after the first semester of first grade 
(Good, 2004), at which time schools begin to 
use CBM-R as a means of assessing students’ 
reading. There is, however, research support¬ 
ing the use of word lists for explaining vari¬ 
ance in students’ reading comprehension be¬ 
yond that which might be explained by stu¬ 
dents’ CBM-R performance (Compton et al., 
2005; Compton et al., 2010; Tilstra et al., 
2009). Although the results of Jenkins et al. 
(2003a, 2003b) may suggest that word list 
reading rate may not be informative beyond 
CBM-R data, these results may be limited by 
the format of the word lists employed. The 
word lists used in both studies were developed 
by randomizing the words within the CBM-R 
passage administered to students. Although 
this procedure allowed for a more direct com¬ 
parison of differences between word identifi¬ 
cation and oral reading rate, it opens the po¬ 
tential for practice as the words that made up 
the first task that students completed were also 
part of the second task they completed (i.e., 
word list or CBM-R passage). Furthermore, 
there may be external validity issues because 
word lists employed by schools are generally 
made up of high-frequency and/or decodable 
words. Use of words from within a passage 
introduces the possibility that the words that 
make up the word identification task are nei¬ 
ther decodable nor words that should be part 
of students’ sight word vocabulary. 

In the current study, we examined stu¬ 
dents’ performance on two types of word iden¬ 


tification lists, with one made up of high- 
frequency words and the other consisting of 
decodable words. Although recent research 
suggests greater concurrent and predictive va¬ 
lidity for students on high-frequency word 
lists as compared to nonsense word fluency 
(Fuchs, Fuchs, & Compton, 2004), no research 
has evaluated both high-frequency and decod¬ 
able word lists. It is possible that these two 
types of probes differentially predict students’ 
reading fluency and comprehension as they 
assess two different skills. Specifically, sight 
word lists containing high-frequency sight 
words do not require most students to use their 
phonetic skills because of repeated exposure. 
In contrast, decodable word lists require stu¬ 
dents to use their decoding skills much like a 
nonsense word fluency measure, but with real 
words. Given the extensive research demon¬ 
strating the importance of phonics to students’ 
development of successful reading skills (Na¬ 
tional Institute of Child Health and Human 
Development, 2000), it is possible that word 
lists developed to evaluate phonemic skills 
will explain variance in students’ reading 
comprehension and text reading not explained 
by a high-frequency word list. Thus, a third 
purpose of the current study was to extend 
research by examining differences in the ex¬ 
tent to which high-frequency and decodable 
word list probe types explain variance in stu¬ 
dents’ reading comprehension. 

A final purpose was to conduct explor¬ 
atory analyses to examine if results would 
generalize to extremely low-achieving stu¬ 
dents. Although we hypothesized that stu¬ 
dents’ CBM-R passage would predict compre¬ 
hension above and beyond their performance 
on word lists, word list performance may be a 
better predictor of comprehension for students 
with poor rates of reading CBM-R passages. 

Method 

Participants and Settings 

Participants were first- (n = 143) and 
second-grade (n = 147) students enrolled in 
one of two elementary schools (School A and 
B) in the southeast region of the United States. 
The majority of first-grade participants were 
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male (58%) and parents identified the stu¬ 
dents’ race/ethnicity as White (79%). A small 
percentage of parents reported their child’s 
race/ethnicity as Hispanic or Latino (8%), 
Black or African American (7%), or noniden- 
tified (6%). The mean age of the first-graders 
was 7.1 years (SD = 0.38, range = 6.5-8.3). 
A total of 5 first-grade students were eligible 
to receive special education services, and 8 
students were designated as English language 
learners. Of the second-grade sample, the ma¬ 
jority were male (62%) and self-identified 
their race as White (62%). In comparison to 
the first-grade sample, a larger percentage of 
second grade students self-identified their 
race/ethnicity as Hispanic or Latino (21%); 
however, a similar percentage self-identified 
their race as Black or African American (8%) 
or nonidentified (8%). The average age of the 
second grade students was 8.0 years 
(SD = 0.44, range = 6.9-10.0). Eight second 
grade students were eligible for special edu¬ 
cation services and 28 students were identified 
as English language learners. 

The participants were enrolled in a total 
of 10 first-grade classrooms (School A = 4; 
School B = 6) and 9 second-grade classrooms 
(School A = 4; School B = 5). School A 
served 540 students in prekindergarten to fifth 
grade. A majority of students (61%) in School 
A received free or reduced-price lunch. School 
B served 450 students in kindergarten through 
fifth grade with 18.9% of the students receiv¬ 
ing free or reduced-price lunch. All participat¬ 
ing students were administered the ITBS 
within classroom and were administered all 
other measures in the hallway adjacent to their 
classroom. 

Materials 

All participating students were adminis¬ 
tered Form A of the ITBS, two CBM-R pas¬ 
sages, a decodable sight word list (decodable 
SWL) and a high-frequency sight word list 
(high frequency SWL). Other measures were 
administered to students during the course of 
the study, but these measures were not rele¬ 
vant to the study and therefore will not be 
described. 


ITBS. Classroom teachers administered 
the appropriate sections of the ITBS to the 
participants, which included Level 7 (first- 
grade students) and Level 8 (second-grade stu¬ 
dents). At the levels assessed, the ITBS com¬ 
prehension subtest requires students to engage 
in a variety of reading tasks by responding to 
questions that reference (a) pictures which 
each tell a story, (b) individual sentences, and 
(c) short passages. The subtests were admin¬ 
istered by teachers who followed scripted in¬ 
structions provided by the test publishers. 
Those students absent on the day of teacher 
administration were individually administered 
the corresponding level by the authors. 

In an attempt to compare the present 
study with results from other studies examin¬ 
ing the shared and unique contributions of 
students’ reading rate and word rate to reading 
comprehension (Jenkins et al., 2003a, 2003b), 
we transformed the Reading Comprehension 
(ITBS-RC) subtest into normal curve equiva¬ 
lents. This permitted the averaging of scores 
because normal curve equivalents are based on 
an equal-interval scale (Mertler, 2002). The 
ITBS comprehension subtests administered 
have a Kuder Richardson-20 internal consis¬ 
tency of .91 for first grade and .89 for second 
grade (University of Iowa, 2005). 

CBM-R. Two CBM-R passages were 
employed for assessing students’ oral reading 
rate in context. First-grade students received 
one preprimer passage, developed by the re¬ 
searchers, and a first-grade CBM-R passage 
selected from the EasyCBM series (http:// 
easycbm.com/). Second-grade students re¬ 
ceived a first- and second-grade EasyCBM 
passage. Evidence exists to suggest that Easy¬ 
CBM passages have adequate reliability and 
validity similar to other CBM-R passages 
(Jamgochian et al., 2010; Lai et al., 2010). 

The passages differed in regard to the 
percentage of unique words presented in each 
passage as well as the percentage of unique 
words that were identified as Spache and/or 
Dolch first-grade sight words. Descriptive data 
regarding the composition of the passages are 
provided in Table 1. First-grade participants 
were administered the preprimer and first- 
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Table 1 

Descriptive Data for CBM-R Passages 



No. of Words 

No. (%) 

Unique Words* 

No. (%) of 
unique words that 
are sight words 

Preprimer CBM-R 

258 

88 (34%) 

50 (57%) 

First-grade CBM-R 

247 

119(48%) 

49 (41%) 

Second-grade CBM-R 

254 

136 (55%) 

58 (43%) 


Note. CBM-R = curriculum-based measures of reading. Number of unique words was determined by deleting all 
repetitions of a word. Thus, the preprimer passages comprised only 88 unique words. Repetition of these words resulted 
in the passage being made up of a total of 258 words. 


grade passages and second-grade participants 
were administered the first- and second-grade 
passages. 

Decodable SWL. Both decodable 
SWLs consisted of 304 phonetically consistent 
real words selected from various word banks 
(e.g.. The Systematic Instructional Manage¬ 
ment Strategies Reading Program Manual ; 
Blackburn, Dickson, Millam, & Nelson, 
1977). Words within the word banks were 
coded as falling within 1 of the 8 decodability 
criterion levels outlined by Menon and Hiebert 
(1999; see also Compton, Appleton, & Hosp, 
2004). These eight decodability levels repre¬ 
sent increasing word difficulty based on lin¬ 
guistic decoding patterns. The first three levels 
represent word constructions that are rela¬ 
tively easy to decode with increasing difficulty 
introduced at each subsequent level by includ¬ 
ing words with silent — e, double vowels, — r 
or —/ endings, or diphthongs (Menon & 
Hiebert, 1999). Words for the first-grade de¬ 
codability list were selected from existing 
word lists if they matched the linguistic pat¬ 
terns outlined in decodability Levels 1-5. Of 
the 304 words used in the second-grade word 
list, 159 words followed the linguistic patterns 
outlined in Levels 1-5, while the remaining 
145 words followed the linguistic patterns out¬ 
lined in Levels 6-8. The second-grade decod¬ 
able word list consisted of words from all 
eight levels as opposed to only the first four 
levels so as to increase the level of difficulty of 
the second-grade probe as compared to the 


first-grade probe. We expected that increasing 
the difficulty would decrease the possibility of 
ceiling effects. 

High-frequency SWL. The high-fre¬ 
quency SWLs were developed using words 
taken from the 315-item Dolch word list 
(Dolch, 1936; Johns, 1971) and from the New 
Instant word list (Fry, 1980). Both word lists 
use words that occur frequently in written 
English materials or were added as comple¬ 
mentary supplements (Fry, 1957). For each 
grade level, 304 words were selected for use. 
This number assured that readers of advanced 
reading ability would have enough words to 
read in the time provided. Although both the 
first- and second-grade SWLs included a se¬ 
lection of words from the Dolch word list and 
the New Instant word list, a greater number of 
less frequent words from the New Instant 
word list were used in the second-grade list to 
reflect the change in grade level. 

Procedure 

Students were administered the Reading 
Comprehension portion of the ITBS during 
either the end of the 6th (School A) or begin¬ 
ning of the 7th month (School B) of the aca¬ 
demic year. Standardized procedures provided 
in the ITBS examiners’ manual were followed 
in the administration of the ITBS. 

Within a week following ITBS admin¬ 
istration, trained experimenters administered 
CBM-R and word list probes to students in a 
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counterbalanced order. First-grade students 
were administered the preprimer CBM-R pas¬ 
sage, first-grade CBM-R passage, first-grade 
decodable SWL, and first-grade high-fre¬ 
quency SWL. Second-grade students were ad¬ 
ministered the first-grade CBM-R passage, 
second-grade CBM-R passage, second-grade 
decodable SWL, and the second-grade high- 
frequency SWL. 

Prior to administration of any probe, ex¬ 
aminers read scripted directions to each stu¬ 
dent. The directions informed students to do 
their best reading, that they would be reading 
multiple types of probes, and that some probes 
may contain nonsense words. Students were 
given 2 min to read each SWL, while exam¬ 
iners recorded errors and provided words on 
which students hesitated for 3 s. The SWL 
outcomes were divided by 2 to provide a direct 
comparison with the 1 -min CBM-R outcomes. 

Standard CBM-R administration and 
scoring procedures were used when students 
were presented with the CBM-R passages 
(Shinn, 1998). Students were allowed to read 
each passage for 1 min, examiners recorded 
words read incorrectly, and provided words to 
students on which they hesitated for 3 s. 
Words misread included words read incor¬ 
rectly given their context, skipped words, and 
substitutions. Insertions and self-corrections 
made within 3 s were not counted as errors. 

Interrater Agreement and Procedural 
Integrity 

Examiners were undergraduate and 
graduate students trained in the scoring and 
administration procedures during an hour-long 
training session completed by the first author. 
In addition, prior to examiners administering 
procedures, they were required to observe one 
of the authors conduct an administration, then 
they conducted an administration while an au¬ 
thor observed them, and finally they were pro¬ 
vided with feedback regarding their adminis¬ 
tration. Examiners were required to attend to a 
procedural checklist, which included verbatim 
instructions to be read to students, to ensure 
procedural integrity. All sessions were audio 
recorded so that independent raters could as¬ 


sess interrater agreement and procedural 
integrity. 

Procedural integrity was evaluated on 
15% of sessions and was calculated by divid¬ 
ing the number of steps completed accurately 
by the total number of steps (40). The average 
procedural integrity was 98% (range = 83%- 
100%). Interrater agreement was assessed on 
15% of sessions from each school. Interrater 
agreement was determined by dividing the 
number of words in agreement by the number 
of agreements plus disagreements. Overall, the 
average interrater agreement was 96.5% 
(range = 93%-99%). 

Data Analysis 

Data screening procedures revealed 
minimal problems with the distribution of the 
variables and no outliers were identified. Eval¬ 
uation of missing data indicated that less than 
1% of the sample (.6%; 12/2030) had missing 
data on one or more of the key study out¬ 
comes. Given the relatively few cases of miss¬ 
ing data and that the missing data appeared to 
represent a random subsample of data, the 
missing cases were deleted in subsequent anal¬ 
yses. This appeared to be the most appropriate 
manner to address the missing data given that 
other procedures for handling missing values 
yields similar results if the missing data reflect 
5% or less of the data set (Tabachnick & 
Fidell, 2007). 

Hierarchical regression analyses were 
used to examine the degree of shared and 
unique variance associated with the predictors 
of reading comprehension and oral reading 
rate of words in context (i.e., average WRCM 
from CBM-R performances). In an attempt to 
compare the present study with results from 
other studies examining the shared and unique 
contributions of students’ reading rate and 
word rate to reading comprehension (Jenkins 
et ah, 2003a, 2003b), we conducted the regres¬ 
sion analyses in pairs, reversing the order of 
the predictors so that the unique contribution 
of each predictor could be determined after 
controlling for the other predictor. For the 
present study, 12 a priori models were speci¬ 
fied for each grade level. The order of predic- 
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Table 2 

Means, Standard Deviations, and Intercorrelations Among Variables for 
First- (n = 143) and Second-Grade (n = 147) Students 


First Grade Second Grade 



Variable 

Mean 

(SO) 

Mean 

(SO) 

1 

2 

3 

4 

5 

6 

7 

1 . 

ITBS Reading Comprehension 

64.04 

(28.11) 

58.74 

(25.75) 

— 

.73 

.75 

.76 

.68 

.66 

.68 

2. 

CBM-R Lower Level 3 

67.05 

(39.21) 

100.87 

(38.77) 

.81 

— 

.88 

.96 

.80 

.83 

.81 

3. 

CBM-R Upper Level b 

58.27 

(42.34) 

93.30 

(39.23) 

.81 

.95 

— 

.97 

.87 

.88 

.88 

4. 

Average CBM-R 

63.13 

(40.25) 

97.10 

(37.96) 

.82 

.99 

.98 

— 

.86 

.88 

.88 

5. 

High Frequency SWL 

36.08 

(25.98) 

48.33 

(24.72) 

.82 

.92 

.91 

.93 

— 

.91 

.98 

6. 

Decodable SWL 

22.30 

(18.87) 

31.95 

(20.60) 

.73 

.89 

.90 

.90 

.93 

— 

.97 

7. 

Average SWL 

22.52 

(12.88) 

40.92 

(20.59) 

.80 

.92 

.92 

.93 

.99 

.97 

— 


Note: ITBS = Iowa Test of Best Skills Reading Comprehension Normal Curve Equivalent; CBM-R = curriculum-based 
measurement for reading; SWL = sight word list; CBM-R scores are words read correct in 1 min. All word lists scores 
are words correct in 1 min. The intercorrelations among variables for the first-grade students are presented below the 
diagonal and the intercorrelations among variables for the second-grade students are presented above the diagonal. All 
intercorrelations were statistically significant, p < .001. 

a CBM-R Lower Level = preprimer passage for first-grade students and first-grade passage for second-grade students. 
b CBM-R Upper Level = first grade passages for first-grade students and second-grade passage for second-grade 
students. 


tors was reversed for each analysis so that the 
unique contribution of reading comprehension 
and word reading rate in context could be 
determined, after controlling for the other pre¬ 
dictors. In an attempt to control for Type I 
error across the 12 models, the Bonferroni 
multiple comparison method was applied, and 
an alpha level of .004 was used for all hierar¬ 
chical regression analyses. 

Results 

Descriptive Statistics 

Preliminary analyses were conducted to 
examine means, standard deviations, and in¬ 
tercorrelations among variables associated 
with the students in first and second grades 
(Table 2). Correlational analyses revealed sta¬ 
tistically significant correlations on all out¬ 
come variables. First, the ITBS-RC NCE was 
highly correlated with first- and second-grade 
students’ CBM-R and SWLs outcomes, with 
correlations ranging in magnitude from .66 to 
.82. Second, the CBM-R scores of the first- 
and second-grade students on varying grade- 
level material were highly correlated, with 


correlations ranging from .88 to .95. Students’ 
average CBM-R outcomes were used through¬ 
out further analyses. Third, the SWLs out¬ 
comes (i.e., high-frequency SWL, decodable 
SWL) of the first- and second-grade students 
were highly correlated, with correlations being 
.93 and.91, respectively. Fourth, CBM-R out¬ 
comes on individual passages and SWLs out¬ 
comes were highly correlated, although the 
magnitude of correlations was slightly higher 
for the first-grade students (range = .89-.92) 
than for the second-grade students 
(range = 0.80-0.88). Finally, a similar pat¬ 
tern of results was observed when comparing 
average CBM-R and average SWL scores, 
with a slightly higher correlation observed for 
first-grade students (.93) than for second- 
grade students (.88). Statistically significant 
grade-level differences were observed among 
outcome measures, wherein the correlations 
among the first-grade sample were signifi¬ 
cantly greater than the second-grade sample 
for CBM-R and high-frequency SWL, 
Z = 3.08, p < .001. No statistically significant 
grade-level differences were observed be¬ 
tween the first- and second-grade samples for 
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CBM-R and decodable SWL, Z = 0.81, p = 

. 21 . 

Differences in Reading Rate Between 
Words Read In and Out of Context 

Paired-samples t tests were conducted to 
evaluate the differences in reading rate between 
words read in and out of context among the first- 
and second-grade students. Across both grade 
levels, the results indicated a statistically signif¬ 
icant difference between students’ average 
CBM-R and high-frequency SWL for first, 
t( 143) = 17.08, p < .001, and second-grade stu¬ 
dents, r( 146) = 24.02, p< .001, with higher 
rates of reading observed for CBM-R (first- 
grade students, M = 63.13; second-grade stu¬ 
dents, M= 97.10) than high-frequency SWL 
(first-grade students, M = 36.08; second-grade 
students, M = 25.98). In addition, across both 
grade levels, the results indicated a statistically 
significant difference between students’ average 
CBM-R and decodable SWL for first-graders, 
t( 143) = 19.67, p < .001, and second-graders, 
f( 146) = 35.57, p < .001, with higher rates of 
reading observed for CBM-R (first-grade stu¬ 
dents, M= 63.13; second-grade students, 
M= 97.10) than decodable SWL (first-grade 
students, M = 22.30; second-grade students, 
M= 31.95). Further, across both grade levels, 
the results indicated a statistically significant dif¬ 
ference between students’ average high-fre¬ 
quency SWL and decodable SWL for first-grad¬ 
ers, <(143) = 14.67, p < .001, and second-grad¬ 
ers, <(146) = 14.91, p < .001, with higher rates 
of reading observed for high-frequency SWL 
(first-grade students, M = 36.08; second-grade 
students, M = 48.33) than decodable SWL 
(first-grade students, M = 22.30; second-grade 
students, M = 31.95). 

Word Reading Rate in Context and 
Word List Reading Rate as Constituents 
of Reading Comprehension Among 
First- and Second-Grade Students 

Hierarchical regression analyses were 
conducted to evaluate the unique contribution 
of first-grade students’ oral reading rate of 
words in context (CBM-R) and of word list 
reading rate (SWL) on their ITBS-RC scores. 


In these analyses, reading comprehension was 
predicted by using students’ average CBM-R 
performance and outcomes from the two 
SWLs (Table 3). Although all of the predictors 
shared significant variance with reading com¬ 
prehension (range = 53%-69%), CBM-R and 
high-frequency SWL scores accounted for 
more unique variance in reading comprehen¬ 
sion. High-frequency SWL scores explained 
14% of the variance in reading comprehension 
scores after controlling for decodable SWL 
scores. Likewise, CBM-R explained 14% of 
the variance in reading comprehension scores 
after controlling for decodable SWL scores. 
However, CBM-R explained only 3% of the 
variance in reading comprehension when con¬ 
trolling for high-frequency SWL. 

Identical hierarchical regression analy¬ 
ses were conducted with the second-grade stu¬ 
dents. Similar to the first-grade results, all 
predictors shared significant variance with 
reading comprehension (range = 43%-60%). 
However, unlike the results for the first-grade 
students, neither SWL explained variance in 
students’ reading comprehension above and 
beyond the other SWL. Conversely, CBM-R 
accounted for more unique variance in stu¬ 
dents’ reading comprehension than SWL out¬ 
comes (Table 3). After controlling for high- 
frequency SWL, 13% of the variance in read¬ 
ing comprehension scores was explained by 
CBM-R. After controlling for decodable SWL 
in the next regression analysis, CBM-R ex¬ 
plained 15% of the variance in students’ read¬ 
ing comprehension. Among second-grade stu¬ 
dents, CBM-R accounted for more than 10 
times the unique variance in reading compre¬ 
hension than did the SWL outcomes. 

Reading Comprehension and Word List 
Reading Rate as Constituents of Oral 
Reading Rate in Context (CBM-R) 
Among First- and Second-Grade 
Students 

Additional hierarchical regression anal¬ 
yses were conducted to evaluate the unique 
contribution of reading comprehension and 
SWLs outcomes on first-grade students’ oral 
reading rate in context (i.e., average CBM-R). 
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Table 3 

Summary of Hierarchical Regression Analyses Using Students’ Average 
CBM-R Performance and Decodable and High-Frequency SWL 
Performance to Predict Reading Comprehension Among First- and Second- 

Grade Students 


First-Grade Students Second-Grade Students 


Regression and Steps 

R 2 

A R 2 

R 2 

A R 2 

A. 1. Decodable SWL 

.53* 


.43* 


2. High-frequency SWL 

.67* 

.14* 

.47* 

.04* 

B. 1. High-frequency SWL 

.61* 


.46* 


2. Decodable SWL 

.61 

.004 

.47 

.008 

C. 1. Average CBM-R 

.61* 


.60* 


2. High-frequency SWL 

.69* 

.02* 

.60 

.001 

D. 1. High-frequency SWL 

.61* 


.46* 


2. Average CBM-R 

.69* 

.03* 

.60* 

.13* 

E. 1. Average CBM-R 

.61* 


Lf\ 

OO 

* 


2. Decodable SWL 

.61* 

.001 

.58 

.001 

F. 1. Decodable SWL 

.53* 


.43* 


2. Average CBM-R 

.61* 

.14* 

.58* 

.15* 


Note. CBM-R = curriculum-based measurement of reading; SWL = sight word list. 
* p < .004. 


Average CBM-R was predicted by using 
scores on the ITBS-RC and SWLs outcomes 
(Table 4). Although all of the predictors 
shared significant variance with CBM-R 
(range = 67%-86%), SWLs outcomes ac¬ 
counted for more unique variance in students’ 
CBM-R performance than did reading com¬ 
prehension (1% and 6%, respectively). After 
controlling for reading comprehension, high- 
frequency SWL reading rate explained 20% of 
the variance in average CBM-R. Similarly, 
after controlling for reading comprehension, 
decodable SWL reading rate explained 20% of 
the variance in average CBM-R. 

Among the second-grade students, hier¬ 
archical regression analyses identical to those 
described earlier were conducted. All three 
predictors shared significant variance with av¬ 
erage CBM-R (range = 58%-78%). Specifi¬ 
cally, similar to the first-grade results, after 
controlling for reading comprehension, both 
high-frequency and decodable SWL outcomes 
accounted for a large percentage of unique 
variance (21% and 26%, respectively; Table 


4). However, reading comprehension ac¬ 
counted for slightly more unique variance 
(6%) than previously reported for the first- 
grade students. 

Reading Performance Levels of Low- 
Achieving First-Grade Students 

In a set of exploratory analyses, a subset 
of low-achieving first-grade students was 
identified (n = 31). These students demon¬ 
strated significant difficulties in their oral 
reading fluency, which was defined as achiev¬ 
ing a percentile rank of 20 or less (i.e., average 
score of 1-20 WRC on CBM-R outcome) in 
comparison to the overall first-grade sample of 
students. By creating a clearly differentiated 
subset of first-grade students, we were able to 
examine whether these students demonstrated 
different patterns of reading performance from 
those previously reported. Only first-grade 
students were selected for this exploratory 
analysis; there were not a sufficient number of 
second-grade students who met the criterion. 
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Table 4 

Summary of Hierarchical Regression Analyses Using Students’ Performance 
on Decodable and High-Frequency SWL and Reading Comprehension 
Outcomes to Predict Oral Reading Rate in Context Among First- and 

Second-Grade Students 


First-Grade Second-Grade 

Students Students 


Regression and Steps 

R 2 

A R 2 

R 2 

A R 2 

A. 1. Decodable SWL 

.81* 


OO 

* 


2. High-frequency SWL 

OO 

* 

.06* 

.80* 

.02* 

B. 1. High-frequency SWL 

* 

SO 

OO 


.74* 


2. Decodable SWL 

OO 

* 

.01* 

.80* 

.06* 

C. 1. Reading comprehension 

.67* 


.59* 


2. High-frequency SWL 

.87* 

.20* 

.80* 

.21* 

D. 1. High-frequency SWL 

.86* 


.74* 


2. Reading comprehension 

.87* 

.01* 

.80* 

* 

SO 

p 

E. 1. Reading comprehension 

.67* 


L/\ 

OO 

* 


2. Decodable SWL 

.87* 

.20* 

* 

co 

OO 

.26* 

F. 1. Decodable SWL 

.81* 


.77* 


2. Reading comprehension 

* 

SO 

OO 

.06* 

OO 

GJ 

* 

.06* 


Note. SWL = sight word list. 
*p < .004. 


Table 5 presents descriptive statistics on key 
outcome measures for these low-achieving 
students. 

To further examine the reading perfor¬ 
mance differences of these first-grade stu¬ 
dents, hierarchical regression analyses were 
conducted to evaluate the unique contribution 
of average CBM-R and SWL outcomes on 
their reading comprehension performance as 
well as the unique contribution of reading 
comprehension and SWL on students’ average 
CBM-R outcomes. The resulting findings are 
described in the following paragraphs. 

Reading comprehension results. In 

the first analysis, reading comprehension was 
predicted by using the scores of the low- 
achieving students’ SWL and average CBM-R 
(Table 6). Unlike our previous findings, only 
average CBM-R shared significant variance 
with reading comprehension. Analyses re¬ 
vealed that none of the three variables shared 
statistically significant unique variance with 


reading comprehension. Observed power for 
the nonsignificant findings ranged from .19 to 
.36, with an average observed power of .29. 

Oral reading rate in context results. 

In the second analysis, the low-achieving first- 
grade students’ average CBM-R was predicted 
by using the students’ scores on the reading 
comprehension and word list reading rate out¬ 
comes (Table 7). Unlike the analyses predict¬ 
ing average CBM-R of first-grade students, 
only high-frequency SWL (69%) and ITBS 
Reading Comprehension (24%) shared signif¬ 
icant variance with average CBM-R. In com¬ 
parison to the analyses including first-grade 
students, there was also substantial difference 
in unique variance. Decodable SWL failed to 
explain significant variance beyond either 
high-frequency SWL or reading comprehen¬ 
sion. High-frequency SWL, however, ex¬ 
plained 64% and 48% of the unique variance 
in average CBM-R outcomes of low-achieving 
hrst-grade students after controlling for decod- 
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Table 5 

Means and Standard Deviations of 
Variables for Low-Achieving First- 
Grade Students (n = 31) 


Variable 

M 

OSD) 

ITBS reading comprehension 

31.47 

(18.00) 

Average CBM-R 

13.98 

(7.61) 

High-frequency SWL 

8.56 

(4.70) 

Decodable SWL 

6.45 

(6.59) 


Note. ITBS = Iowa Test of Best Skills Reading Compre¬ 
hension Normal Curve Equivalent; CBM-R = curricu¬ 
lum-based measurement for reading (scores are words 
read correct in 1 min). SWL = sight word list (all SWL 
scores are words correct in 1 min). 


able SWL and reading comprehension. Read¬ 
ing comprehension explained 21% of the 
unique variance in the average CBM-R of 
low-achieving first-grade students when con¬ 
trolling for their decodable SWL reading rate. 
Reading comprehension did not explain sig¬ 
nificant unique variance after controlling for 
high-frequency SWL. Observed power for the 
nonsignificant findings ranged from .20 to .39, 
with an average observed power of .31. 

Discussion 

Extensive research exists demonstrating 
a strong relationship between students’ 
CBM-R performance as measured by WRCM 
and their comprehension of text. This relation¬ 
ship can be explained by Perfetti’s (1985, 
1992) verbal efficiency theory, which suggests 
that with greater proficiency/rate in reading 
words, students are able to attend more to the 
meaning of a passage. A primary purpose of 
this study was to evaluate among early readers 
the extent to which CBM-R reflects more than 
word reading rate. Specifically, the study ex¬ 
tended research by Jenkins and colleagues 
(2003a, 2003b), which demonstrated not only 
that CBM-R explained greater variance in 
reading comprehension than students’ reading 
of a word list, but also that students’ (a) 
CBM-R rate was greater than their word read¬ 
ing rate on a word list; (b) word list reading 


Table 6 

Summary of Regression Analyses for 
Variables Predicting Reading 
Comprehension Among Low- 
Achieving First-Grade Students 




Regression and Steps 

R 2 

A R 2 

A. 

1 . 

Decodable SWL 

.04 



2. 

High-frequency SWL 

.18 

.14 

B. 

1 . 

High-frequency SWL 

.17 



2. 

Decodable SWL 

.18 

.003 

C. 

1 . 

Average CBM-R 

.24* 



2. 

High-frequency SWL word 





rate 

.24 

<.001 

D. 

1 . 

High-frequency SWL rate 

.12 



2. 

Average CBM-R 

.24 

.13 

E. 

1 . 

Average CBM-R 

.24* 



2. 

Decodable SWL 

.25 

.006 

F. 

1 . 

Decodable SWL 

.04 



2. 

Average CBM-R 

.25 

.21 


Note. SWL = sight word list; CBM-R = curriculum- 
based measurement of reading. 

* p < .004. 


rate did not explain variance above and be¬ 
yond CBM-R; and (c) comprehension ex¬ 
plained more variance, and twice as much 
unique variance in students’ CBM-R perfor¬ 
mance than word list reading rates. The find¬ 
ings of the current study provide further sup¬ 
port for Perfetti’s verbal efficiency theory and 
further validate that CBM-R measures more 
than students’ word reading skills. Results do 
not, however, exactly mimic those of previous 
research, which is likely a function of meth¬ 
odological differences coupled with the lower 
developmental reading level of the 
participants. 

Similar to previous research (Jenkins et 
al., 2003a; Nicholson, 1991), participants’ oral 
reading rate of words in context was signifi¬ 
cantly greater than their rate of reading words 
out of context. These results applied across 
grades for both high-frequency words and de¬ 
codable words. Thus, students’ reading rate on 
the high-frequency word lists, which consisted 
of words that were all likely part of their sight 
vocabulary, was slower than their reading rate 
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Table 7 

Summary of Regression Analyses for 
Variables Predicting Oral Reading 
Rate Among Low-Achieving First- 
Grade Students 




Regression and Steps 

R 2 

A R 2 

A. 

1. 

Decodable sight word list 





(SWL) 

.05 



2. 

High-frequency SWL 

.70* 

.64* 

B. 

1. 

High-frequency SWL 

.69* 



2. 

Decodable SWL 

.70 

.002 

C. 

1. 

Reading comprehension 

.24 



2. 

High-frequency SWL 

.72* 

.48* 

D. 

1. 

High-frequency SWL 

.69* 



2. 

Reading comprehension 

.72 

.03 

E. 

1. 

Reading comprehension 

.24 



2. 

Decodable SWL 

.26 

.02 

F. 

1. 

Decodable SWL 

.05 



2. 

Reading comprehension 

.26 

.21 


Note. SWL = sight word list. 
* p < .004. 


when reading words presented in context de¬ 
spite the fact that some of the words in context 
were low-frequency and not decodable words 
(Table 1 provides percentages of words within 
passages that were sight words). In extending 
previous research, these data provide evidence 
that reading words in context facilitates stu¬ 
dents’ word reading, suggesting that the ad¬ 
ministration of a CBM-R probe results in a 
score that represents more than students’ read¬ 
ing of individual words (i.e., word lists). 

Analyses of students’ rate of reading 
words also indicated that students’ rate of 
reading the high-frequency SWL was signifi¬ 
cantly greater than their rate of reading the 
decodable SWL. These data suggest that the 
high-frequency SWLs were at a minimum 
composed of more high-frequency words than 
the decodable SWL despite the fact that all of 
the words across the SWLs were in fact sight 
words. Moreover, not all sight words are the 
same and thus not all SWLs will produce 
equivalent results. In a review of the literature, 
Pratt, Martin, White, and Christ (2011) re¬ 


ported that definitions of sight words ranged 
from words that were recognized immediately, 
to words seen often within text, to words that 
did not require preparation by students to read. 
The variability in the types of SWLs that are 
available is a primary reason why two SWLs 
were administered in the current study, with 
one containing words that students were ex¬ 
pected to know based upon frequency within 
text and another containing highly decodable 
words. 

The fact that the two word lists resulted 
in differences in students’ reading rates pro¬ 
vides evidence that effort must be placed into 
the development of SWLs, if the desire is to 
develop multiple probes that are equivalent in 
level of difficulty and thus useful for universal 
screening and/or progress monitoring. Similar 
to recent evidence examining the equivalence 
of CBM-R probes within probe sets, evidence 
of the reliability and validity of probes is not 
sufficient to establish them as appropriate for 
progress monitoring (Ardoin & Christ, 2008; 
Ardoin & Christ, 2009; Ardoin, Christ, 
Morena, Cormier, & Klingbeil, 2013). Fur¬ 
thermore, the current data were consistent 
with previous research that found that read¬ 
ability formulas were not appropriate mea¬ 
sures of CBM-R probe difficulty (Ardoin, Car- 
folite, Christ, Roof, & Klubnick, 2010; Ar¬ 
doin, Suldo, Witt, Aldrich, & McDonald, 
2005; Betts, Pickart, & Heistad, 2009), as 
many of these formulas treat all sight words as 
equivalent and evaluate probe difficulty based 
upon the number of words that are not sight 
words. 

A second purpose of the current study 
was to examine the utility of administering 
word lists in addition to CBM-R with first- and 
second-graders. The hierarchical regression 
analyses closely resembled the findings from 
Jenkins et al. (2003a, 2003b) because CBM-R 
explained significant unique variance in read¬ 
ing comprehension after controlling for the 
decodable SWL and after controlling for the 
high-frequency SWL. Also in an identical 
fashion to Jenkins et al. (2003), neither SWL 
accounted for significant unique variance in 
reading comprehension for the second-grad¬ 
ers, beyond that accounted for by CBM-R. 
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Although this was not the case for first-grad¬ 
ers, the unique variance explained by the high- 
frequency SWL was relatively small as com¬ 
pared to the variance explained by CBM-R. 
Data from the second-graders more closely 
aligned with previous research in regard to the 
magnitude of variance explained by the sec¬ 
ond-graders’ oral reading rate. Specifically, 
CBM-R accounted for 13% and t5% of 
unique variance in reading comprehension af¬ 
ter accounting for high-frequency and decod- 
able SWLs for second-grade students, whereas 
CBM-R explained only 3% and 14% of unique 
variance in reading comprehension for first- 
grade students. In regard to the magnitude by 
which CBM-R explained variance in reading 
comprehension above SWLs, results for both 
first- and second-grade students is substan¬ 
tially less than results reported by Jenkins et 
al. (2003b), in which the unique variance ex¬ 
plained in fourth-grade students’ reading com¬ 
prehension by CBM-R after controlling for 
word list reading was 41%. 

One potential explanation for CBM-R 
accounting for less variance in students’ read¬ 
ing comprehension is that the less skilled a 
reader is, the less that context might affect oral 
reading rate of words in context versus word 
list reading. Perfetti’s (1985, 1992) theory 
suggests that when students’ attention is ded¬ 
icated primarily to decoding words, their at¬ 
tention to the meaning of a story is dimin¬ 
ished. If students are not attending to the 
meaning of a story, then it is unlikely that the 
context of the story will affect their reading 
rate to the same extent that it might for stu¬ 
dents who are able to devote attention to the 
meaning of a passage. Although there is de¬ 
bate regarding the extent to which students use 
context to read unknown words based upon 
their reading skills (Jenkins et al., 2003a, 
2003b), with some suggesting that poor read¬ 
ers use context more than skilled readers 
(Nicholson, 1991; Zinar, 2000), it may be that 
some basic level of word reading rate and 
accuracy is required prior to students being 
able to use context. Thus, context may play 
less of a role and their sight word vocabulary 
may play a larger role. Further evidence sug¬ 
gesting that context may not affect the word 


reading rate for some readers is provided by 
the significantly stronger relationship between 
hrst-grade students’ CBM-R and SWL out¬ 
comes as compared to second-grade students’ 
CBM-R and SWL outcomes. The correlation 
between hrst-grade students’ average CBM-R 
and the two SWLs O = .91 and r = .90) was 
nearly identical to that of the relationship be¬ 
tween the two SWLs. 

Another interesting hnding, which dif¬ 
fers from that of previous research, was the 
amount of variance explained in students’ 
CBM-R performance by their SWL perfor¬ 
mance and ITBS-RC (Table 4). Similar to 
Jenkins et al. (2003b), in the present study 
students’ reading comprehension explained 
signihcant unique variance in their CBM-R 
performance. However, in contrast to Jenkins 
et al., the magnitude by which SWL explained 
unique variance in CBM-R was consistently 
greater than the unique variance explained by 
students’ reading comprehension perfor¬ 
mance. Likewise, the magnitude of unique 
variance in CBM-R performance explained by 
SWL for both hist- and second-grade students 
in this study exceeds that reported by Jenkins 
et al. (2003b). These data again provide some 
evidence that context may affect the perfor¬ 
mance of hrst- and second-grade students to a 
lesser extent than it does for students in upper 
elementary grades. At a bare minimum, these 
data suggest that variance in hrst- and second- 
grade students’ word identihcation skills af¬ 
fects their CBM-R performance to a greater 
extent than it does for older students. Poten¬ 
tially, differences may be a function of less 
variability in the performance of upper ele¬ 
mentary grade students in word identihcation 
skills and/or differences in the relationship 
between word decoding, reading fluency, vo¬ 
cabulary, and comprehension among students 
in different developmental stages of reading 
(Tilstra et al., 2009). 

The final set of analyses was exploratory 
and only included the data from a small sam¬ 
ple of low-achieving hrst-grade students. Al¬ 
though the data should be interpreted with 
extreme caution, the results do provide further 
support for CBM-R as a global measure of 
reading achievement. Results also provide fur- 
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ther evidence that context may play less of a 
role in the reading of CBM-R passages and/or 
sight word skills play a larger role in the 
reading of CBM-R passages for less skilled 
students. In support of CBM-R as a global 
measure of reading achievement, results indi¬ 
cated that even with only a small sample of 
students and a restricted range of WRCM 
(0-20 WRCM), CBM-R shared significant vari¬ 
ance in students’ reading comprehension out¬ 
comes. As evidence that context plays less of a 
role in students’ reading of CBM-R passages for 
low-achieving students, high-frequency SWL 
outcomes explained unique variance in CBM-R 
performance after accounting for variance in 
reading comprehension. However, as was re¬ 
ported in the results, reading comprehension out¬ 
comes did not explain unique variance in 
CBM-R after accounting for the low-achieving 
students’ high-frequency SWL performance. 
These findings provide preliminary support that 
it would be beneficial for school personnel to 
administer SWL to low-achieving students in 
order to better differentiate among these types of 
students. 

Limitations 

The primary limitation associated with 
this study is the number of regression analyses 
conducted and thus the increased probability 
of committing Type 1 errors. However, most 
findings were consistent with past research 
and those that were not consistent differed in 
that observed shared/unique variances were 
less than expected based upon past research 
with older students. Although some of these 
observed variances were recognized as signif¬ 
icant, we acknowledge that they were lower 
than that observed in past research. 

Another limitation to be considered is 
the relatively small sample size of low-achieving 
students and the fact that these students were 
identified as low achieving based upon a mea¬ 
sure used within the analyses conducted. It is 
therefore essential that these analyses be treated 
as exploratory. Future studies are needed to eval¬ 
uate the benefit of administering a SWL in ad¬ 
dition to CBM-R passages to low-achieving 
first-grade students. It may be that when con¬ 


ducting universal screenings, school profession¬ 
als should consider administering a SWL to first- 
grade students performing below a prespecified 
CBM-R level. This would possibly allow 
schools to further distinguish the reading skills 
of low-achieving students. 

Other limitations to consider when in¬ 
terpreting the findings from this study include 
(a) the use of only one word list of each SWL 
type, (b) the administration of all measures 
during a single time frame (winter administra¬ 
tion), and (c) the inclusion of only two 
schools. These limitations decrease the gener- 
alizability of the findings. Finally, on occa¬ 
sions, comparisons were made to findings of 
previous research, especially that of Jenkins et 
al. (2003a, 2003b). Although these studies 
also used the ITBS as a criterion measure, it is 
important to remember that their word list 
differed considerably from those employed in 
this study. Whereas the high-frequency and 
decodable SWLs employed in this study 
closely approximated those that might be used 
in the schools for universal screening pur¬ 
poses, the word list used by Jenkins et al. 
(2003a, 2003b) was developed using the 
words contained within the CBM-R probe ad¬ 
ministered to students. To appropriately make 
comparisons between lower and upper ele¬ 
mentary students, all students should be ad¬ 
ministered materials developed using similar 
procedures. 

Implications 

Results of this study provide further 
support for the utility of CBM-R in evaluating 
students’ reading achievement. Not only was a 
strong relationship once again found between 
students’ CBM-R performance and a standard¬ 
ized measure of reading comprehension, but 
the current findings suggest that students’ per¬ 
formance on CBM-R passages explains vari¬ 
ance above and beyond their reading of word 
lists. Thus, these data further dispel sugges¬ 
tions made that CBM-R simply measures the 
rate at which students are able to read words. 
For both first- and second-grade students, con¬ 
text does facilitate their reading of words within 
CBM-R passages. However, results also provide 
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evidence that context may influence first- and 
second-grade students’ CBM-R performance to 
a lesser degree than students in upper elementary 
grades and that context affects first-grade stu¬ 
dents’ CBM-R performance to a lesser degree 
than it does for second-grade students. Thus, 
although CBM-R procedures do not directly 
measure students’ comprehension skills, stu¬ 
dents’ comprehension skills seem to affect their 
performance as does their ability to read sight 
words and high-frequency words. The interpre¬ 
tation of CBM-R as a general outcome measure 
seems appropriate. 

Although word list reading may not ex¬ 
plain variance in comprehension beyond that 
explained by CBM-R, word list reading ap¬ 
pears to explain variance in CBM-R perfor¬ 
mance beyond that of reading comprehension 
for beginning readers. The variance in reading 
comprehension explained by CBM-R likely 
accounts for (a) differences in oral reading rate 
of words in context between readers who com¬ 
prehend at least some of what they read to 
nonreaders who are unable to comprehend 
anything they read as their cognitive resources 
are entirely allocated to decoding; and (b) 
variability among students who are able to 
comprehend what they read but their compre¬ 
hension is affected by the variability in the 
extent to which they dedicate cognitive re¬ 
sources to decoding and not the comprehen¬ 
sion of passages. However, there remains vari¬ 
ance to explain in the reading achievement of 
students who are unable to comprehend what 
they read, which can potentially be explained 
by word lists. Additional research is needed to 
both replicate these findings and to determine 
if word lists can be used to help further dis¬ 
tinguish struggling beginning readers. 
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